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ABSTRACT 

An examination of Dutch research on legal case 
solving revealed that few law students get systematic instruction or 
testing in the technique of legal problem solving. The research being 
conducted at the Department of Computer Science and Law at the 
University of Amsterdam focuses on identifying the different 
functions in legal reasoning tasks in order to develop computational 
models which realize these functions. The major assumptions of the 
theory are: (l) in artificial legal reasoning, a separation should be 
made between reasoning about events in the world and reasoning about 
legt\ consequences; and (2) the ^'real" legal reasoning (when no 
reasoning about the world is conceived) should be viewed as a process 
of rule application and conflict resolution, rather than drawing 
logical inferences. The consequences of these assumptions for 
knowledge representation are, that in representing regulation 
knowledge, knowledge about the actions, agents, and objects should be 
separated from the representation of the regulation. In an 
intelligent tutoring system (ITS), the system and the student perform 
the task simultaneously; the way the system reasons has to be 
functional for educational purposes. The domain under study is 
administrative procedural law. The main educational goal of a student 
solving a case is to learn to handle the theoretical concepts in a 
specific field of law, to learn to find and apply the specific body 
of norms, to learn tc oian the courses of action and to learn to 
construct a solution which is legally correct. A conceptual model of 
assessment, a typical task in the domain of law, is under development 
as part of the library of interpretation models; an interpretation 
model is an abstract conceptual model of a set of problem solving 
methods in terms of inference steps. The model can be used in ilhe 
process of acquiring knowledge for building artificial legal problem 
solvers. (AEF) 



Towaxcls automated training of legal problem solving 



Antoinette J. MuntjewerfF 



00 



00 
00 
CO 



Dtpartmtnt of Computer Science and Law 
Faculty of Law, University of Amsttrdam 
KUwtnxerfibxiujxual 72, 1012 CZ Amsttrdam, The Netherlands 
e- m a il antoi @/r t .jxi r,nva,nl 



Q 



Abstract: The motivation to study legal problem solving originates 
from observations in Dutch legal education. Consultation of Dutch re- 
search on legal case solving confirmed the assumption that, in using cases 
in legal education, a method, or explicit strategy, is lacking. However 
the methods proposed in the research by Crombag, de Wijkerslooth, <t'. 
C'ohen (1977) and Abas & Broekers-Knol (1985) contain some important 
shortcomings. Research on artificial legal problem solving as proposed 
and performed by my department is the starting point for the study of 
automated training of legal problem solving. The domain under study 
is administrative procedural law. To be able to train students in legal 
problem solving a thorough analysis should be made of the task involved 
and the knovviedge necessary for accomplishing the task. Because of the 
fact that training is involved a teachable model has to be constructed. 



General description aud motivation of the reseaixh 

It' you a^k experienced practitioners how they learned to tackle legal problems aii<l to find the 
appropriate set of noim.s, the chances are that they will say 'trial aud error*, 'hit and miss' or similar 
vague expressions. It is possible that they never actually 'learned' it at all, in the sense of being 
taught. Few law students get systematic instruction or testing in the techni(iue of legal j)rol)leni 
solving. This observation was the starting point of research done in the Netherlands by drombag, 
de Wijkerslooth. van Tuyll van Serooskerken (1972) and Crombag, de Wijkerslouth, .V Cohen 
(1977). They Were confronted with the situation that there was no explicit strategy or method 
for teaching students legal problem solving. The problem solving process of legal piacrit.ioners 
(in this case judges in the field of civil law) was studied. Thinking aloud protocols were gathered 
and a rational reconstruction of the [)roblem solving ]>rocess w;us perfornu'd. The idea behind this 
approach was that the constructed strategy could be used for instructing students on how to solve 
legal problems. The constructed strategy consists of a series of steps to be taken by the student 
in the course of solving a legal problem. The strategy was adai>ted by Abas iV. Broekers-Knol 
(lUSS) and reconstructed into a smaller series of steps. These methods were constructed for use 
in legal education, not for im])lementation in a Comj)uter Assisted Instructional (CAI) |u'<jgrarn 
or an Intelligent Tutoring System (ITS). This research and my own experiences in legal education 
lead to tlie conHnnation that legal education is in need of a way to instruct students explicitly 
in how to solve a Cii.se and to provide an opportunity for students to get skilled in solving legal 
cases. Because there is no time in the official curriculum for training students in this skill, an 
automated tool couhl be of use to train students in legal problem solving. However, the probhim 
with the <levelo[)ed problem solving strategies is that they only consist of a series of steps to take 
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I»y till' proMiMii solvrr (in ihis cMst* tin* .st iKlciit). For i\ uiothod or strategy t.o be t^tacliahlc in an 
artilicial proMrni m»1v<t certain rccunivnitMits are n(*((-ssary. FirsI of all t.lic uie^t.liod ii^rds to liave.* 
a kiiul of rai.ionalr, a justification ol what. kind of proMcms can h^. solved using t.liis method. Next 
to that it nnist \u- rh'ar what kind of products come out. of an intermediate step in the process. 
Ev<'ry st<*p in th«' prohh'in solving i>rocess, every action, has to have an outcome. These outcouies 
must he specified in Drder to provide coaching. Furtlierniore there has to be a relation between the 
strategy and flir knowledge needed to perform the problem solvmg task. Law sttidents learn about 
legal concepts in statutes and doctrine, but they do not know how to apply this knowledge to 
procet'd from a sprriMc legal case to an analysis of the problem and an assessment of the situation 
according to a spcrific body of norms. Students do not know how to aj)ply their knowledge to a 
sjM'cific ca.sr. i r liow i(, make the stej) from support knowledge to operational knowledge. They 
have ((> learn lo M'h'ct and tpialify facts from a specific situation in legal terms/concepts and link 
those ternis/conci'pts to rules. There is however a lack of strategy which can give support in the 
problem solving process. There is no method which tells the students how to proceed, even worse, 
it is not clear to the student what is expected of her. Students need to gain insight in the task 
involved, in the knowledge needed to perform the task and in the method or course of actions to 
take to accomplish the task. Empirical studies with law students solving an administrative law 
]trol)l(Mn show that students do not have a task structure other than a kind of trial and error 
approach (Mimt jewerff. H)U3). Research on artificial legal problem solving as performed at my 
department is the starting i)oint of my research. This research provides a new way to approach 
legal problem solving and to think about the tasks involved and the knowledge and methods needed 
for teaching h-^al problem solving. 

Artificial Itigal i>r()hleiii solving 

The )<^s,^•l|(h (arried out by the department of Computer Science and Law focuses on repre- 
sentation of le;;al knowledge and on modelling legal problem solving tasks. The research aims at 
constructing; a tlM-ory on legal re.'isoning. The theory is not a psychological theory. The process of 
legal re asoning of the legal practitioner is not the focus of the research. The focus is on constructing 
a theory of legal problem solving/legal reasoning, like the approach in (modern) legal theory. The 
theory under con.struction is about ariifinal legal reasoning. The research is on identifying the 
different (abstract) functions in legal reasoning tasks and to develop computational models which 
realise these fniH tioiis. In research on artificial legal problem solving the models of knowledge 
representation can be tested by implementing these in a system. Research focuses on the abstract 
functions involved in many legal reasoning tasks and on architectures which support these func- 
tions. The majoi assumptions of the theory under construction are : 

- In artificial legal reasoning a separation should be made between reasoning about events in the 
world and reasoning about legal consecpiences of states in the world. 

- The "real" legal reasoning (when no reasoning about the world is concerned) should be viewed 
as a process of rule application and conflict resolution, rather than drawing logical inferences. 
The consequence.s of these assumptions for knowledge representation are, that in representing 
regulation knowledge, knowledge about the actions, agents and objects (in the world ruled by the 
regulation) should be separated from the representation of the regulation. The architecture derived 
from this view gives the specifications of funct.ions and structure of a legal practitioners workbench 
to be. The architecture can be enhanced to support various types of tasks of legal practitioners. 
For example giving advice in cases re<iuires an extension in communication functions which can 
transform a story into a legally relevant situation descrijition and in planning facilities to optimise 
legal courses of act.ion (Breuker, 15)90; Breuker k den Haan, 11)91). The proposed architecture can 
be enhanced to support the tasK of training students in a variety of legal tasks (drafting legislation, 
planning courses of action, argimientation. advice). 
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Training by means of an Intt»lligent Tutoring System (ITS) 

An ITS is a knowledge based system in which the major function is to coach novices in acquiring 
expertise in some domain of problem solving. An ITS accomplishes this function by booking over 
the shonldei ' of the student who solves a problem presented by the system. The ITS monitors the 
students problem solving behaviour and compares this with the systems own knowledge about the 
domain. This means that both the student and the ITS perform the same (sub) task at the same 
time. When there is a discrepancy between the performance of the system and the performance 
of the student thi.s is diagnosed in terms of misconceptions or a lack of knowledge at the side of 
the student. The ITS expertise is the standard. The outcome of the diagnoses triggers a related 
remedy to correct the misconception or lack of knowledge. To be able to perform the problem 
solving task an ITS has to embody an expertise component just like a knowledge based system 
(KBS). However the requirements for expertise to be taught demand more from the model. The 
way the know^Iedge is structured should be different and the reasoning process has to be more 
transparent. 

Given the proposed theory on artificial legal reasoning and the conseciuences the assumptions have 
on knowledge representation and computational logic, and given the proposed architecture what 
extensions, refinements or adaptations need to be made when the function of a system is training 
law students legal problem solving? When the system performs legal reasoning on a task the way 
proposed in Breaker (1990) and Breuker k den Haan (1991) what kind of adjustments have to be 
made in order to he able to train legal problem solving to students? In an ITS the system and the 
student perform on the task at hand at the same time. The way the system reasons, goes about the 
task and solves the problem, has to be functional for educational purposes. Research on developing 
a training system for diagnosis in physiotherapy shows that the domain knowledge of an ITS needs 
to be more explicit and deep (VVinkels, 1992). Next to that a model of expertise, constructed 
in the knowledge actpiisition phase of a project, is a descriptive model. The teachability of the 
strategy howpver implies a prescriptive strategy, an ex|)licit strategy for solving legal cases that 
can be learned and executed by students. 

The domain of administrative procedural law 

The domain under study is the domain of administrative procedural law. The legal sources 
involved are the (ieneral Administrative Law (in dutch de Algemene Wet Be.st uursrecht, AWB), 
case law and other legal texts. In administrative law a set of instruments is provided for local and 
governmental authorities to accomplish certain objectives. Next to that administrative law pro- 
vides guarantees for citizens. Public nature and participation are guarantees proceetling a decision 
of an authority, legal protection is a guarantee afterwards. At the re(pie.st of one or more citizens, 
a more or less independent authority checks if the administration follows or followed the rules. In 
a conflict between a local or governmental authority and a citizen there li;u<; to be a judgement by 
an independent court.. However before a conflict reaches the court the administration itself may he 
<isked to give an opinion on the attacked decision of the administration, d'enerally speaking there 
are two courses of action for a party concerned : 

- to start administrative appeal. This means that a decision taken by an administration will be 
tested by an other administration (most of the time higher in the hierarchy) on re(iuest of a party 
concerned. 

- to make objections. The admin istratioiial body which has taken the decision will reconsider the 
case on re([uest of the party concerned. 

In both cases there is no independent court involved, hut even so this is also called legal protec- 
tion. The body or bodies of authority which have to test or reconsider the decisions taken are 
obligatorily stated in the law. The system is (juite complicated. The legislator has stated different 
factors which determine which procedure has to he followed. 

These Oirtors concern the nature of the disputed actions of the authority, the field in which the 
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ilispulrd action \v,i.s taken, thr «jnality of tin' parly fotncmcd. tin* typt* of administration that 
lias takt'ii tlir ({^(ision In the new (ieneral Adniinist.rat.ive Law (AWB) tin* procedure of inaking 
(>l)ject.ioiis (and ask the administration to reconsider the decision) is a pre-procednre for admission 
to the conrl. The recent, reorganisation of the courts in the Netherlands has providtid new admin- 
istrative colleges in the jaw courts. Solving problems in the domain of administrative j)rocediiral 
law involves planning and assessment. Because the exchange of documents between the parties 
involved plays an mi])ortant role ui the administrative procedure, students need to learn to assess 
the form and <nnient of the documents involved, need to learn to act and react in the procedure, 
need t.o leavn t.o construct the necessary documents and need to learn to plan the course of action. 
In doing so they need to learn to take the standpoint of the official body as well as the standpoint 
<»f the cit.izen(s). 

A cast^ tlc'.scriptioii 

A legal ras(\ as used in Dutch legal education, is a written description (a kind of restricted 
st-ory) of a (potential) j>robleni situation in which some facts and events are mentioned. A link 
with a c<utain field of law is already made. A case description is about a half page t,o a page 
long and ends with a (piestion which restricts the problem situation and the possible solutions to 
the problem (the ipiestion sets the direction and puts the student on a certain trac). The main 
educational goal of solving a case is (for a student) to learn to handle the theoretical concepts in 
a specific field of law. to learn t.o find and apply the specific body of norms, to learn to plan the 
courses of action and to learn to construct a solution which is legally correct. Administrative law- 
experts and sludents from the faculty of Law at the University of Amsterdam were engaged in 
solving the problem below. The thinking aloud protocols gathered in this experiment will be used 
for (re)coiistrucling tiie niotlei for teaching legal problem solving. The student protocols will be 
used for detecting misconceptions and lacks of knowledge. 

Maytir and ;il(lt'rmeii of Nfaastricht decided hy degree of 30 July 1981, to grant permission to the Bowl 
corporjitioH in Maastricht, under clause 56 of the Housing Act, to use the house at Looiersgracht number 
12 a.*; an office. This is under the condition that the corporation makes suitable for residence (for one and 
two j)ers(>n households) the office at Looiersgracht number 8 which is in ownership of the Bowl corporation. 
The Proviuci;d ('orporation for Mental Health in Linihurg which has an office at Looiersgracht number 
8 is very much opposed to the decision of the Mayor and aldermen. 

What artions < an they take and at which moment? 

Domain it^pi<iS(^iitatioii and task model 

A teachable model for legal problem solving has to be constructed and decisions on how to teach 
this model to law .students have to be made. A rational reconstruction of the domain knowledge 
and problem .solving strat.e.gies are necessary^ because there is no suitable approach neither in 
instructional material or in practice. Experts solving problems have an approach which is not 
suitable for teaching (according to a first analysis made of thinking aloud protocols of experts 
in the fi<;ld of administrative law, solving an administrative law problem). An analysis of the 
types and structures of the domain knowledge is needed. Besides that, an interj^retation model 
from the KADS library of interpretation models is a starting point for modelling the task and 
the inferences. Regiilations consist of abstract norms and definitions. There are also regulations 
which define authority. Procedural law contains definitions, procedures and courses of action and 
divides tasks and plans over time. To construct a model of the world actions, objects and agent.s 
are distinguished and hi(Tarcliies of types are constructed. The.se typologies are used in reasoning 
(doiiHaan k' Breukei. To model the world of administ rat ive procedural law ty])e hierarchies 

and consist-of relations are constructed 
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Figure 1: Examples of tree structures in the domain of Administrative procedural law 



A most typical task in the domain of law is assessment. A case (situation, events) has to be 
assessed according to a botly of norms, Less frequently occurring tasks are drafting of regulations 
(a design task) or finding courses of action (a planning task). But even then assessment is implied. 
For example in administrative law different kinds of documents play a role. First of all a re(piest 
is made to an authority for a permit. Then a decision is made by the authority. There is a 
possibility of objecting against the decision. For the party directly involved a.s well a,s for a third 
party concerned. They have to write a complaint and send it to the official I)ody. There is a lot of 
interaction going on on paper, documents are exchanged, a file grows. Tliis excliange of <locunients 
plays ail important role in the administrative process. You have to be in time for the right document 
and write the riglit kind of objections to be able to proceed. In tlie process of action and reaction a 
case is build so to speak. Depending on the ;>tate of the documents and tlie position in the process 
a certain kind of problem may arise (so a specific case is build) wliich recpiires a solution in the 
form of a decision. In this procedure planning as well as assessment is involved. A conceptual 
model of assessment is under development in the ComnionKADS project as [)art of the library of 
interpretation models (Aamodt et al, 1992). An interpretation model is an al)stract conceptual 
model of a set of problem solving methods in terms of inference steps. This model can be used in 
the f>rocess of actjuiring knowledge for building artificial legal problem solvers. Assessment tasks 
are characterized by the fact that a description of a ca*^e (situation, events) has to be compared 
(lifis to be apj)lied) to norms in order to reach a decision. The task of iu<sessiuent consists of 
two subtasks. CJase abstraction and norm application. In case abstraction a vnsf description is 
translated into abstract terms, the relevant items are selected and abstracted. A ciuse description is 
a structure of events or situations. The abstraction is in most cases identification or classification 
of instances as concepts. The inference that has to take place is abstraction/transformation. An 
event or situation in the world lu'u^ to be abstracted (to be able to c.ornpare it to a norm, norms are 
statet! in abstract terms) and/or transformed (to a legally relevant concept, event or situation). 
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abstract 
case description 



Figure 2; Legal assessment 



Suniiiiary 

A rcpn- ntalioii ui Uie domain knowledge, especially representing the world in which the 
r('gnlat.io)js play a role, lias to he performed. The function of the prospective system is education, 
this mcians that the knowledge should he structured in a way suitable for teaching and learning. 
The ta.sks involved should he modelled. The assessment model could be a starting point to model 
the ta.^^k of .^ulviu^ administrative law problems. Thinking aloud protocols of experts in the field 
of adiiiiiiistiative law and of students of the law faculty will be used in this modelling process. 
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